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Abstract 


This  paper  examines  the  set-theoretic  interpretation  of  morphological  filters  in  the 
framework  of  mathematical  morphology  and  introduces  the  representation  of  classical 
linear  filters  in  terms  of  morphological  correlations,  which  involve  supremum/infimum 
operations  and  additions.  Binary  signals  are  classified  as  sets  and  multilevel  signals 
as  functions.  Two  set-theoretic  representations  of  signals  are  reviewed.  Filters  are 
classified  as  set-processing  (SP)  or  function-processing  (FP).  Conditions  are  provided 
for  certain  FP  filters  that  pass  binary  signals  as  binary  to  commute  with  signal  thresh¬ 
olding,  because  then  they  can  be  analyzed  and  implemented  as  SP  filters. 

The  basic  morphological  operations  of  set  erosion,  dilation,  opening,  and  closing  are 
related  to  Minkowski  set  operations  and  are  used  to  construct  FP  morphological  filters. 
Emphasis  is  then  given  to  analytically  and  geometrically  quantifying  the  similarities 
and  differences  between  morphological  filtering  of  signals  by  sets  and  functions;  the 
latter  case  allows  the  definition  of  morphological  convolutions  and  correlations.  Toward 
this  goal  various  properties  of  FP  morphological  filters  are  also  examined. 

Linear  shift-invariant  filters  (due  to  their  translation-invariance)  are  uniquely  char¬ 
acterized  by  their  kernel,  which  is  a  special  collection  of  input  signals.  Increasing  linear 
filters  are  represented  as  the  supremum  of  erosions  by  their  kernel  functions.  If  the  fil¬ 
ters  are  also  discrete  and  have  a  finite-extent  impulse  response,  they  can  be  represented 
as  the  supremum  of  erosions  only  by  their  minimal  (with  respect  to  a  signal  ordering) 
kernel  functions.  Stable  linear  filters  can  be  represented  as  the  sum  of  (at  most)  two 
weighted  suprema  of  erosions.  These  results  demonstrate  the  power  of  mathemati¬ 
cal  morphology  as  a  unifying  approach  to  both  linear  and  nonlinear  signal-shaping 
strategies. 
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1  INTRODUCTION 


Morphological  filters  are  nonlinear  signal  transformations  that  locally  modify  geometric 
features  of  signals.  They  stem  from  the  basic  operations  of  a  set-theoretical  method  for 
image  analysis,  called  mathematical  morphology ,  which  was  introduced  by  Matheron  [l] 
and  Serra  [2].  In  this  method  each  signal  is  viewed  as  a  set  in  a  Euclidean  space,  and 
the  morphological  filters  are  set  operations  that  transform  the  graph  of  the  signal  and 
can  provide  a  quantitative  description  of  its  geometrical  structure.  For  binary  signals 
(viewed  as  sets),  the  erosion  (contraction),  dilation  (expansion),  opening,  and  closing  are 
the  simplest  morphological  operations.  Set  erosion  and  dilation  are  actually  Minkowski 
set  subtraction  and  addition  [3,4],  respectively.  These  filters  were  extended  to  multilevel 
signals  in  [2, 5, 6, 7, 8]  by  using  mainly  the  correspondence  between  the  shrinking/expanding 
of  binary  signals  and  the  local  min/max  of  multilevel  signals  [9],  Serra  [2]  used  the  cross- 
sections  (thresholded  versions)  of  the  signal  to  generalize  the  morphological  filtering  of 
multilevel  signals.  Sternberg  [6]  further  generalized  morphological  filters  for  multilevel 
signals  by  considering  graytone  images  as  surfaces  of  3-D  volumes  (the  umbrae).  E-filters 

[10]  are  related  to  morphological  filters  via  Sternberg’s  approach.  Lantuejoul  and  Serra 

[11]  studied  properties  of  generalized  (algebraic)  openings  and  closings,  which  they  called 
M-filters. 

The  applications  of  morphological  filters  in  image  processing  and  analysis  are  numer¬ 
ous  [2,12,13].  Areas  of  applications  include  biomedical  image  processing  [2,6,8,14,15];  au¬ 
tomated  industrial  inspection  [16,17];  shape  recognition  [18];  nonlinear  filtering  [19, 20]; 
edge  detection  [5,20,13];  noise  suppression  [5,21,20,13];  thinning  [2,5,21,20,22];  enhance¬ 
ment  [2,21];  representation  and  coding  [20,22];  texture  analysis  [23];  and  shape  smoothing 
[2,20,22,24].  Currently,  there  are  several  commercialized  image  analyzers  or  other  pipelined 
or  parallel  computer  architectures  [25]- [28]  that  use  morphological  filters  (mainly  for  binary 
signals)  among  their  main  operations  to  extract  pictorial  information. 

In  this  paper,  first  (in  Section  2)  we  introduce  a  classification  of  signals  and  filters 
suitable  for  morphological  filtering.  Then  we  discuss  the  basic  morphological  concepts  for 
representing  signals  by  sets.  In  Section  3  we  give  the  basic  definitions  and  properties  of  the 
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four  simplest  morphological  filters.  Although  [2]  is  an  excellent  treatment  of  mathematical 
morphology,  we  feel  that  it  is  worthwhile  to  present  some  review  material  in  Sections  2 
and  3  for  completeness  and  clarity,  as  well  as  for  familiarizing  the  signal  processing  society 
with  morphological  signal  analysis.  Throughout  Section  3  we  attempt  to  clarify  the  transi¬ 
tion  and  oscillation  between  morphological  filtering  of  binary  and  multilevel  signals.  Some 
analysis  and  examples  are  provided  to  quantify  the  difference  between  morphologically 
convolving  a  signal  with  another  binary  or  multilevel  signal.  In  addition,  some  determin¬ 
istic  properties  of  morphological  filters  for  multilevel  signals  are  investigated  concerning 
their  commutability  with  thresholding,  fixed  points,  and  invertibility.  Finally,  in  Section  4 
we  introduce  the  representation  of  linear  shift-invariant  filters  in  terms  of  morphological 
filters.  That  is,  we  define  the  kernel  of  a  linear  translation-invariant  filter  as  a  special 
collection  of  input  signals  and  construct  a  basis  of  this  kernel  based  on  a  signal  ordering. 
The  kernel  or  basis  functions  are  then  used  to  express  a  linear  convolution  as  a  supremum 
of  subtractive  morphological  correlations  (erosions) . 

This  paper  is  the  first  in  a  sequence  of  two  papers  (Part  1  and  2).  The  results  in  Sec¬ 
tion  4  of  this  paper  (Part  l)  and  the  results  in  Part  2  [32]  are  all  special  cases  of  our  earlier 
work  in  [19,20],  which  showed  that  a  large  class  of  nonlinear  and  linear  translation-invariant 
filters  can  be  represented  exactly  in  terms  of  a  minimal  combination  of  morphological  ero¬ 
sions  or  dilations.  Both  Parts  1  and  2  demonstrate  the  power  of  mathematical  morphology 
as  a  unifying  approach  to  both  linear  and  nonlinear  signal-shaping  strategies. 

2  REPRESENTATION  OF  SIGNALS  BY  SETS 

An  m-dimensional  (m-D)  signal  can  be  represented  mathematically  by  a  function  of  m 
independent  variables  (an  m-D  function),  where  m  is  any  positive  integer.  This  function 
may  assume  only  two  distinct  values,  in  which  case  we  can  represent  the  signal  as  a  set  in 
an  m-D  Euclidean  space.  For  example,  a  binary  image  can  be  represented  by  a  function 
f(x)  that  assumes  only  two  values,  i.e.,  zero  and  one.  Alternatively,  the  image  foreground 
can  be  represented  by  the  set  S  =  {x  :  f(x)  =  1}  and  the  image  background  by  the  set 
complement  Sc  =  {x  :  f{x)  =  0}.  This  function  /  is  called  the  characteristic  function  of  S. 
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Henceforth,  both  functions  and  sets  will  be  used  as  mathematical  representations  of  signals, 
with  the  distinction  that  an  m-D  function  implies  a  multilevel  m-D  signal,  whereas  an 
m-D  set  refers  to  a  binary  m-D  signal.  Thus,  a  binary  image  will  be  represented  by  a  2-D 
set,  whereas  a  graytone  image  by  a  2-D  function.  This  classification  of  signals  induces  a 
similar  classification  for  filters  into  set-processing  and  function-processing  filters.  An  m-D 
set-processing  (SP)  filter  is  a  filter  capable  of  accepting  m-D  binary  signals  as  inputs 
and  producing  m-D  binary  signals  as  outputs.  An  m-D  function-processing  (FP)  filter 
is  any  filter  capable  of  accepting  m-D  functions  as  inputs  and  producing  m-D  functions 
as  outputs.  A  subclass  of  m-D  FP  filters  can  produce  an  m-D  binary  signal  whenever  the 
input  is  also  an  m-D  binary  signal;  these  are  called  function-and-set-processing  (FSP) 
filters.  For  example,  on  sampled  graytone  images  a  moving  local  minimum  operation  is  a 
2-D  FSP  filter,  whereas  a  moving  local  averager  is  a  2-D  FP  (but  not  a  FSP)  filter. 

In  the  above  classification  set  is  the  primary  notion  and  function  is  just  a  particular 
case,  because  the  prototype  morphological  filters  are  defined  through  set  operations.  In 
addition,  some  of  the  FSP  filters  that  this  paper  examines  commute  with  thresholding  of 
functions  (explained  later)  and,  hence,  can  be  reduced  to  SP  filters.  In  this  light  then,  any 
FP  or  SP  filter  is  viewed  as  a  set  transformation  from  one  class  of  sets  into  another  class 
of  sets.  The  concept  of  a  set,  however,  is  more  general  than  needed  to  represent  signals. 
Therefore,  we  restrict  ourselves  to  a  class  of  sets  that  is  just  sufficiently  general.  Assuming 
[l]  that  every  set  representing  a  signal  (viewed  as  an  image  object)  contains  its  boundary, 
results  in  selecting  the  class  C(E)  of  all  closed  subsets  of  a  Euclidean  space  E  as  our  general 
signal  space.  However,  before  any  detailed  discussion,  it  is  necessary  to  introduce  some 
notation. 

Notation:  The  set  of  real  numbers  is  denoted  by  R,  and  the  set  of  integers  by  Z. 
Capital  letters  “A,  B,C, . . .  X,Y”  mainly  denote  sets;  points  of  sets  are  denoted  by  lower 
case  letters  “a,  6,  c, . . . ,  x,y,z”.  Xc  denotes  the  set  complement  of  X.  The  set  of  points  x 
satisfying  a  property  “P”  is  denoted  by  {x  :  P}.  If  XCR,  then  sup(X),  inf(X),  max(X), 
and  min(X)  denote,  respectively,  the  supremum,  infimum,  maximum,  and  minimum  of 
X.  (See  [29]  for  the  differences  between  sup/inf  and  max/min,  respectively.)  Functions 
are  denoted  by  “/,  g,h”.  Capital  Greek  letters,  e.g.,  u'&,  denote  SP  filters,  whereas 
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lowercase  Greek  letters,  e.g.,  uip,  <j>n  denote  FP  filters.  If  X  or  /  are  input  signals  to  filters 
\fr  or  if},  then  ^(X)  and  V’(Z)  denote  output  signals. 

2.1  Cross-sections  and  Umbra  of  a  Function 

We  assume  that  the  domain  of  an  m-D  function  /(x )  is  a  subset  of  the  domain  space 
D  =  Zm  or  Rm,  depending  on  whether  the  function  is  sampled  or  not,  respectively.  We 
also  assume  that  the  range  of  /(x)  is  a  subset  of  the  range  space  V=R  or  Z,  depending 
on  whether  the  amplitude  of  /(x)  varies  continuously  or  discretely.  Our  general  Euclidean 
space  E  will  be  equal  to  the  cartesian  product  D  X  V.  Thus,  ail  binary  m-D  signals  will 
be  subsets  of  D,  whereas  all  multilevel  m-D  signals  will  be  subsets  of  E. 

Since  signals  can  be  represented  either  by  functions  or  by  sets,  and  set  is  the  primary 
notion,  the  main  issue  is  to  represent  functions  by  sets.  This  is  done  by  following  two 
different  but  equivalent  approaches.  That  is,  an  m-D  function  can  be  represented  either 
by  an  ensemble  of  m-D  sets  called  its  cross-sections  or  by  a  single  (m  +  l)-D  set  called  its 
umbra. 

Figure  1  shows  a  1-D  function  /,  one  of  its  cross-sections,  and  its  umbra.  The  set 

Xt{f)  =  {x  G  D  :  /(x)  >  t}  ,  f€V,  (1) 

is  called  the  cross-section  of  /  at  level  t  and  is  obtained  by  thresholding  f  at  level  t.  By 
considering  all  different  levels  t  we  can  associate  f  with  a  family  of  sets,  which  decrease 
monotonically  as  t  increases.  Since  we  work  in  the  class  of  closed  sets,  all  the  cross-sections 
of  /  must  be  closed.  The  corresponding  class  of  functions  with  which  we  will  always  deal 
is  the  class  of  upper  semi  continuous1  (u.s.c.)  functions  on  D,  denoted  as  t75C(D).  This 
correspondence  is  established  because  a  real-valued  function  f  defined  on  Rm  is  u.s.c.  if  and 
only  if  (iff)  its  cross-sections  Xt(f)  are  closed  sets  in  Rm  for  all  t  £  R  [31] .  Qualitatively, 
we  can  think  of  u.s.c.  (resp.  l.s.c.)  functions  as  resulting  from  continuous  functions  after 
the  addition  of  some  positive  (resp.  negative)  jumps.  A  sampled  function  is  trivially  both 
u.s.c.  and  l.s.c.,  because  all  its  cross-sections  are  subsets  of  Zm  and,  hence,  they  are  both 
closed  and  open. 

1  These  are  defined  in  [29,30]  together  with  the  lower  semincontinuous  functions  (l.s.c.) 
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If  we  know  all  the  cross-sections  of  an  u.s.c.  function,  then  we  can  uniquely  reconstruct 
it  through  a  supremum  operation.  This  is  illustrated  in  Fig.  2  which  shows  a  1-D  function 
f(x)  and  two  of  its  cross-sections  at  levels  ti  and  f2.  In  this  figure  we  observe  that,  for  a 
given  point  x  £  R,  x  £  Xtl(f)  iff  f(x)  >  t\.  By  contrast,  we  observe  that  x  Xt2(f)  iff 
f(x)  <  t^.  Thus,  the  value  of  /  at  x  is  equal  to  the  “largest”  (supremum)  of  f’s  such  that 
m  >  t ,  or,  equivalently,  x  £  Xt(f).  The  above  discussion  is  formalized  by 

THEOREM  1  (Serra  [2]).  (a)  Let  f(x)  be  an  u.s.c.  real-valued,  function  on  Rm  and 
let  Xt(f),  t  £  R,  be  its  cross-sections.  Then,  the  Xt’s  are  closed  sets  in  Rm  that  are 
decreasing,  i.e., 

t\  <  f 2  ==^  Xtl  2  Xt3,  (2) 

obey  a  monotonic  continuity 

X,  =  f]Xt,  (3) 

t<T 

and  for  each  x  £  Rm 

*  /( i)  =  sup{t  £  R  :  x  £  Xt}  .  (4) 

(b)  Conversely,  a  collection  {Xt  :  t  £  R},  of  closed  sets  satisfying  conditions  (2)  and  (S) 
generates  an  u.s.c.  function  f[x)  through  (4).  Then,  the  cross-sections  of  the  resulting 
function  f{x)  are  identical  with  the  initial  sets  Xt’s  for  all  t. 

Note  that  if  V=  Z,  then  (3)  becomes  XT  =  flr»<7-  Xn  with  r,  n  £  Z,  and  hence  (3)  is  trivially 
satisfied;  (4)  becomes  f[x )  =  sup{t  £  Z  :  x  £  X*}. 

Another  way  of  establishing  a  link  between  sets  and  functions  involves  the  concept  of 
the  umbra  due  to  Sternberg  [6,7].  As  shown  in  Fig.  1,  the  umbra  U(f)  of  /  is  a  subset  of 
E  and  consists  of  all  those  points  that  occupy  the  space  below  the  graph  of  /  down  to  —  oo. 
We  can  also  define  the  umbra  of  a  set.  For  instance,  Fig.  3a  shows  a  closed  set  B  in  R2. 
Its  umbra  U(B)  is  the  closed  set  formed  as  follows:  Let  the  points  in  E  be  parametrized 
by  their  projection  x  on  D  and  their  altitude  t  perpendicular  to  D  (in  Fig.  3  D=  R). 
Suppose  that  the  opaque  set  B  is  “illuminated”  from  above  by  a  point  source  located  at 
t  —  +oo;  then  the  shadow  of  B  is  its  umbra  U(B)  shown  in  Fig.  3a.  Analytically,  the 
umbra  of  the  closed  set  B  is  equal  to  the  Minkowski  sum  (defined  later  in  (12))  of  B  and 
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the  negative  axis  (— oo,0]  of  the  amplitudes  Vs  [2].  Similarly,  the  umbra  of  a  function  /  is 
the  Minkowski  sum  of  the  graph  of  the  function  and  (— oo,0],  where  the  graph  of  f  is  the 
set  G(f)  =  {( x,t )  GE:  /(x)  =  t}  shown  in  Fig.  3b.  Analytically,  the  umbra  of  /  is  the 
subset 

W)  =  {(M)  e  D  x  V  :/(*)>  *}  (5) 

of  E.  Obviously,  the  umbra  is  a  set  of  higher  dimensionality  than  the  function.  Figure  3b 
shows  that  a  point  ( x,t )  belongs  to  U(f)  iff  /(x)  >  t.  The  second  property  of  £/(/)  is 

that  if  (x,t)  €  U(f),  then  (x,a)  6  £/(/)  for  all  a  <  t  (see  also  Fig.  3b),  since  the  set 

{x}  x  (— oo,/(x)]  is  a  subset  of  t/(/).  From  U(f)  we  can  uniquely  reconstruct  /,  because 
/(x)  is  the  “largest”  altitude,  i.e.,  the  supremum  of  all  V s  such  that  (x,t)  £  £/(/).  The 
third  property  of  U(f )  is  that  it  is  a  closed  set.  The  class  of  functions  whose  umbra  is  a 
closed  set  in  E  is  the  class  of  u.s.c.  functions  on  D;  further,  for  each  u.s.c.  function  there 
corresponds  a  unique  umbra,  and  vice-versa.  Next  we  formalize  the  above  discussion  with 

THEOREM  2  .  (a)  To  any  real-valued  u.s.c.  function  /(x),  x  £  Rm,  there  corresponds 
a  unique  umbra  U(f).  This  umbra  U  is  a  closed  set  in  Rm+1  such  that: 

[x,t)  £  U  <=>  t  <  f(x)  x  €  Xt(f )  .  (6) 

(x,t)  €  U  =>■  (x,  a)  G  U  ,  Va  <  t  .  (7) 

Also  for  each  x  €  Rm 

/(x)  =  sup{t  6  R  :  (M)  e  v } .  (8) 

(b)  Conversely,  to  any  closed  subset  U  of  Rm+1  satisfying  (7)  there  corresponds  a  unique 
u.s.c.  function  f(x),  which  can  be  constructed  from  (8).  The  umbra  then  of  f[x)  is  equal 
to  U. 

A  proof  of  Theorem  2  can  be  found  in  [20,  p.54].  Theorem  2  also  holds  for  functions  with 
discrete  argument  or  amplitude.  By  comparing  (1)  and  (5)  with  (6),  we  see  that  U(f)  is 
the  union  of  the  sets  [Xt(/)]  x  {t}  for  all  t  €  V. 
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2.2  Isomorphic  Operations  between  Sets  and  Functions 

Since  functions  are  exactly  represented  by  their  umbrae,  union  and  intersection  of  umbrae 
must  isomorphically  induce  two  equivalent  operations  between  the  corresponding  functions. 
Figure  4  shows  two  functions  /  and  g  and  their  respective  umbrae  U(f)  and  U(g).  The 
intersection  of  the  two  umbrae  is  an  umbra  corresponding  to  a  new  u.s.c.  function.  This 
function,  shown  by  the  dashed  curve  in  Fig.  4,  is  equal  to  the  pointwise  minimum  of  /  and 
g.  Likewise,  the  union  of  the  two  umbrae  is  the  umbra  of  a  new  u.s.c.  function,  which  is 
shown  by  the  solid  curve  in  the  right  part  of  Fig.  4,  equal  to  the  pointwise  maximum  of  / 
and  g.  We  denote  these  new  functions  as: 

(/  A  g)(x)  =  min{f(z),g(x)}  ,  i£D. 

(fVg)(x)  =  max{/(x),g(x)}  ,  x  G  D. 

Finally,  the  set  inclusion  of  umbrae,  which  is  an  ordering  relation,  induces  an  ordering 
relation  between  functions  too.  Set  inclusion  between  the  umbrae  of  two  functions  /  and  g 
corresponds  to  an  ordering  of  functions.  That  is,  we  say  that  “/  is  less  than  g” ,  denoted 
as  “/  <  gn,  iff  f{x)  <  g(x)  VxeD.  Moreover, 

f<g  <=*  Xt(f)  c  Xt(g)  vt  e  v  <=*  u(f)  c  u(g) .  (9) 

Table  I  shows  the  types  of  function  operations  induced  by  set  operations  on  umbrae  or 
cross-sections;  e.g.,  A(v)  between  /  and  g  is  equivalent  to  n(u)  between  Xt(f )  and  Xt{g) 
for  all  t  €  V. 

2.3  Upper  Semicontinuous  (u.s.c.)  Filters 

A  detailed  formal  definition  of  a  general  u.s.c.  filter  (viewed  as  set  mapping)  lies  beyond  the 
scope  of  this  paper.  Intuitively  speaking,  a  filter  is  u.s.c.  if  it  is  continuous  “from  above”. 
However,  if  the  SP  or  FP  filter  is  increasing  (see  Table  II  for  definitions),  then  we  can  easily 
verify  whether  it  is  u.s.c.  as  follows.  If  (X„)  is  a  decreasing  sequence  of  closed  sets  in  E,  let 
Xn  i  X  denote  the  monotonic  set  convergence  where  Xn+i  C  Xn  for  all  n  and  X  =  fin  Xn. 
Then,  if  \F  is  an  increasing  SP  filter  in  C(E),  'F  is  u.s.c.  iff  Xn  [  X  ==>  'F(Xn)  [  'F(X) 
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[l].  An  obvious  way  to  extend  these  concepts  to  FP  filters  is  to  consider  the  umbrae  or 
cross-sections  of  functions.  Leaving  details  aside,  if  (/„)  is  a  decreasing  sequence  of  u.s.c. 
functions,  we  denote  by  /„  j  /  the  monotonic  convergence  toward  the  u.s.c.  function  /, 
where  /„+ 1  <  /„  for  all  n  and  f(x)  =  inf„{/„(x)}  for  all  x  G  D.  Then,  if  ip  is  an  increasing 
FP  filter  in  USC(D),  ip  is  u.s.c.  iff  fn  [  f  =>  ^(/n)  J.  V’(Z)- 

The  u.s.c.  condition  is  necessary  whenever  we  require  filters  to  be  insensitive  to  the 
fine  variations  in  both  the  amplitude  and  region  of  support  of  signals. 

2.4  FSP  Filters  that  Commute  with  Thresholding 

Let  <p  be  an  m-D  FSP  filter  and  let  $  be  the  respective  m- D  SP  filter  of  cp.  Then  <j>  is  said 
to  commute  with  thresholding  iff,  for  any  u.s.c.  function  /, 

xt[4>{f)\  =  *[*,(/)]  ,  vt  e  v.  (10) 

Thus,  for  a  general  FSP  filter  (p  satisfying  (10),  transforming  the  input  function  f  and 
then  thresholding  <p(f )  at  any  level  t  is  equivalent  to  thresholding  /  at  level  t  and  then 
transforming  by  $  the  set  Xt(f).  This  allows  us  to  interpret  such  a  FP  filter  as  a  SP 
filter,  which,  especially  for  sampled  signals,  is  simpler  to  analyze  and  implement.  That  is, 
from  Theorem  1  and  (10)  we  can  synthesize  the  output  function  4>{f)  from  its  SP-filtered 
cross-sections: 

[*(/)](*)  =sup{t€V:t€  *[*,(/)]}  ,  ViGD.  (11) 

A  necessary  condition  for  a  FSP  filter  to  commute  with  thresholding  is  given  by 

THEOREM  3  .  Let  <p  :  7  — *  C/SC(D)  be  a  FSP  filter  defined  on  a  subclass  JC  CLSC(D) 
of  u.s.c.  functions  closed  under  pointwise  infimum.  If  (p  commutes  with  thresholding  and 
$  is  its  respective  SP  filter,  then  both  <p  and  $  are  increasing  and  u.s.c. 

Proof.  (a)-(Increasing):  Let  A,B  be  two  closed  sets  in  D  such  that  AC  B.  Let  h  be 
an  u.s.c.  function  defined  as  h(z)  =  2  for  x  G  A,  h(x )  =  1  for  x  G  B  n  Ac  and  h{x)  = 
0  for  i  G  Bc .  Then  $(A)  =  $[X2(h)]  =  X2[<P(h)]C  Xx[4>{h)\  =  $[Xi(h)]  =  $(£). 

Thus,  4  is  increasing  for  sets.  Now  let  f  <  g  <==>  Xt(f)C  Xt(g)  Vt  G  V.  Then 
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Xt{<f>{f)\  —  ^[^t(/)]C  $[ATt(y)]  =  Xt[<f>{g )]  Vt  G  V,  which  implies  that  <  <f>{g). 
Hence,  <f  is  increasing  for  functions  too. 

(b)-(u.s.c):  Let  S  be  the  set  class  of  all  cross-sections  of  functions  in  7\  then  S  is 
closed  under  intersection,  because  7  is  closed  under  infimum.  Let  ( Xn )  be  any  decreasing 
sequence  of  closed  sets  in  S ;  then  X„  |  X  G  S.  By  generalizing  the  method  of  proof 
in  (a),  we  can  set  Xn  —  Xtn(f)  for  some  u.s.c.  function  /  where  tn+ 1  >  tn  for  all  n, 
t  =  supn{f„},  and  X  =  Xt{f).  From  (2)  and  (3),  since  <f>(f)  is  an  u.s.c.  function,  we  have 
$(ATn)  =  Xtn[<f>(f)\  |  Xt[4>(f)\  =  $(X).  Thus  $  is  u.s.c.  Likewise,  let  (/„)  be  a  decreasing 
sequence  of  u.s.c.  functions  such  that  /n  J.  /  G  /.  Then  fn  [  f  =>  Xt(fn)  |  Xt(f)  => 
XtWn)}  =  *[Xt{fn)}  1  ${Xt(f)}  =  Xt[4>[f) j  Vt  €  V  =►  4>{fn)  >  Hfn+ 1)  and  [^(/)](x)  = 
sup{t  :  x  e  xt{<p(f)}  O  (x)  >  t  Vn}  =  inf„{[<?i(/„)](x)}.  Thus  ^(/„)  |  and 

hence  (f>  is  u.s.c.  Q.E.D. 

Theorem  3  suggests  a  straightforward  way  to  construct  a  FSP  filter  that  commutes 
with  thresholding  from  an  increasing  and  u.s.c.  SP  filter  That  is,  if  $  operates  individ¬ 
ually  on  all  the  cross-sections  of  an  u.s..c.  function  /,  the  family  of  filtered  cross-sections 
($[Xt(/)]  :  t  €  V}  satisfies  both  conditions  (2)  and  (3).  Hence  Theorem  1  guarantees 
that  the  function  g[x)  =  sup{£  G  V  :  x  €  $[AT((/)]}  is  an  u.s.c.  function  and  that 
Xt(g )  =  $[Xt(/)]  for  all  t  €  V.  Thus,  by  setting  g  =  <£(/),  we  construct  a  FSP  filter  <f 
that  commutes  with  thresholding  and  whose  respective  SP  filter  is  $. 

Theorem  3  becomes  a  necessary  and  sufficient  condition  by  requiring  <j>  to  be  translation- 
invariant.  Let  Az  =  {a  +  z  :  a  G  A}  denote  the  translate  of  a  set  A  by  the  vector  z.  A 
SP  filter  'F  is  translation-invariant  iff  =  [^(A)]z,  for  all  z  G  E  and  all  sets  A 

in  a  set  collection  5  closed  under  vector  translation.  If  A  —  U(f),  translation  of  A  by 
z  —  (y,c)  corresponds  to  a  shift  of  the  argument  of  /(x)  by  y  G  D  and  to  a  shift  of  the 
amplitude  of  /  by  c  G  V.  Thus,  we  define  herein  a  FP  filter  if  as  translation-invariant  iff 
ip[f(x  —  y)  +  c]  =  [i p(f)}(x  —  y)  +  c,  for  all  (y,c)  G  D  x  V  and  all  functions  f{x)  in  a 
function  class  7  closed  under  such  translation.  Then  we  have 

THEOREM  4  .  A  translation-invariant  FSP  filter  <f>  :  7  — ►  USC{ D),  where  7  is  a 
class  of  u.s.c.  functions  closed  under  translation  and  pointwise  infimum,  commutes  with 
thresholding  iff  it  is  increasing  and  u.s.c. 
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Proof.  The  necessity  was  proven  in  Theorem  3.  Sufficiency:  Throughout  this  proof  we  will 
make  use  of  the  SP,  FSP,  and  FP  erosions  filters  which  are  defined  in  Section  3.  Let  $  be 
the  respective  m-D  SP  filter  of  the  m-D  filter  <t>.  $  is  defined  on  the  set  class  S  of  the  cross- 
sections  of  the  functions  in  J .  Since  (f>  is  a  translation-invariant  and  increasing  FP  filter, 
it  is  equal  to  the  supremum  of  FP  erosions  by  a  class  K  of  functions  [20].  These  functions 
must  be  binary,  i.e.,  m-D  sets,  because  otherwise  4>  would  not  pass  an  m-D  binary  signal 
as  binary.  Thus,  <£(/)(x)  =  supBg^  {/  ©  iP(x)},  where  /  ©  B‘(x)  —  inf{/(y)  :  y  £  Bx } 
is  the  FSP  erosion  of  /  by  B  and  commutes  with  thresholding.  Hence,  if  /  is  binary  and 
thus  equal  to  the  characteristic  function  of  a  set  Y ,  then  the  above  expression  for  4>{f) 
becomes  3>(F)  =  U Be)(  Y  ©  Bs,  where  YQBS  =  {z  :  Bz C  F}  is  the  SP  erosion  of  Y  by 
B.  However,  $  is  a  translation-invariant  and  increasing  SP  filter  and,  hence,  equal  to  the 
union  of  SP  erosions  by  all  sets  B  in  its  kernel  K($)  =  {X  E  S  :  0  £  3>(X)}  [l].  Thus  the 
class  K  in  the  above  representation  of  <f>  is  actually  the  kernel  of  its  SP  filter  4>,  and  hence 


[*(/)](*) 


sup  {/©B*(x)},  Vx  £  D,  /  E  7. 
BeK(<b) 


In  addition,  Vt  £  V, 


#[*«(/)]=  U  [Xt(f)}eB’=  u  xt{f  ©  b*). 

BeK(<b)  BeK{9) 

Since  $  is  increasing  and  u.s.c.,  the  set  class  {$[X((/)j  :  t  £  V}  creates  an  u.s.c. 

function  g(x)  =  sup {t  £  V  :  x  £  3>[Xt(/)]}  =  sup{t  :  x  £  Xt(fQB’)  <=>-  fQBs(x )  > 
t,  for  some  B  £  K($)}  =  sup ©  •Ss(2:)}-  Hence  g  =  <f>(f).  The  cross-sections  of  g 
are  (Theorem  1)  Xt(g)  —  $[Xt(/)],  and  thus  <j>  commutes  with  thresholding.  Q.E.D. 

Not  all  FSP  filters  commute  with  thresholding.  Examples  of  FSP  filters  that  commute 
with  thresholding  include  median  and  order-statistic  filters  [32]  as  well  as  erosion,  dilation, 
opening,  and  closing  of  functions  by  sets,  which  are  defined  in  Section  3.3. 


3  MORPHOLOGICAL  FILTERS 

In  morphological  filtering  each  signal  is  viewed  as  a  set,  and  its  geometrical  features  are 
modified  by  morphologically  convolving  the  signal  with  a  structuring  element,  which  is 
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another  set  of  simple  shape  and  size  [2].  By  varying  the  structuring  element  we  can  extract 
different  types  of  information  from  the  signal.  According  to  the  four  quantification  princi¬ 
ples  of  mathematical  morphology  [2],  each  morphological  filter  (viewed  els  a  set  mapping) 
must  be:  1)  translation-invariant,  2)  scale-invariant  (in  Rm),  3)  dependent  only  on  local 
knowledge  of  the  signal,  and  4)  u.s.c.  A  sufficient  condition  for  a  morphological  convolu¬ 
tion  to  be  u.s.c.  is  to  use  compact  sets  or  functions  with  a  compact  region  of  support  as 
structuring  elements. 

In  a  morphological  convolution  the  signal  and  the  structuring  element  could  be  either 
sets  or  functions.  Thus,  in  this  section  we  present  the  similarities  and  differences  between 
the  basic  SP  and  FP  morphological  filters  and  examine  some  of  their  properties. 

3.1  Morphological  Filters  of  Sets  by  Sets 

Morphological  filters  of  sets  by  sets  are  SP  filters  processing  input  m-D  sets  by  interacting 
them  via  Minkowski  set  addition  or  subtraction  with  structuring  elements  that  are  compact 
n-D  sets  ( n  <  m).  The  Minkowski  set  addition. [3, 4]  of  the  sets  4,  BC  Rm  is  the  set 

A  ©  B  =  {a  +  6  :  a  €  A,  b  £  B }  =  Ab  ,  (12) 

beB 

where  Ab  =  {a  +  b  :  a  £  A}.  The  Minskowski  set  subtraction  [4]  of  B  from  A  is  the 
set 

AQ  B  =  (Ac  ®B)C  =  fl  Ab  .  (13) 

beB 

Let  Bs  =  {—b  :  b  £  B}  denote  the  symmetric  set  of  B  with  respect  to  the  origin,  and 
0  denotes  the  empty  set.  The  basic  SP  morphological  filters  are  the  erosion  XQB % 
dilation  X®B“ ,  opening  Xb,  and  closing  XB  of  X  by  B ,  defined  in  [l]  as: 


XQB'  =  {z:Bz  CX}  =  f]X-»  (14) 

beB 

X®B‘  =  {z:B,nX^  0}  =  1J  X-b  (15) 

beB 

XB  =  {XeB')®B  (16) 

XB  =  {X®B')eB.  (17) 


From  (14)-(17)  and  Fig.  5  we  observe  the  following:  Geometrically,  the  erosion  of  X  and 
B  is  defined  as  the  set  of  all  points  z  such  that  the  translate  Bz  is  contained  in  the  original 
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set  X\  the  dilation  of  X  by  B  is  defined  as  the  set  of  all  points  z  such  that  Bz  intersects  X. 
Algebraically,  the  erosion  of  X  by  B  is  equal  to  the  Minkowski  set  subtraction  of  B‘  from 
X\  the  dilation  of  X  by  B  is  the  Minkowski  sum  of  X  and  B.  Dilating  X  is  equivalent  to 
eroding  Xc  and  complementing  the  result  as  implied  by  (13).  The  opening  of  X  by  B  is 
the  set  resulting  from  erosion  of  X  by  B  followed  by  Minkowski  sum  with  B\  this  cascade 
does  not  generally  recover  X ,  but  rather  a  subset  of  X  which  is  the  morphologically  most 
essential  part  with  respect  to  B.  From  (12),  (14),  and  (16)  it  follows  that 

XB=  U  Bz.  (18) 

B.CX 

Similarly,  the  closing  of  X  by  B  results  from  dilating  X  by  B  and  then  Minkowski  sub¬ 
tracting  B  from  the  result;  in  general,  the  closing  of  X  is  a  set  containing  X.  Closing  X 
is  equivalent  to  opening  Xc  and  complementing  the  result. 

To  visualize  geometrically  these  morphological  filters  we  assume  that  we  deal  with  2-D 
sets,  which  may  represent  binary  images.  Thus,  let  the  closed  set  X  represent  a  binary 
image  and  the  compact  set  B  a  structuring  element,  such  as  the  island  and  the  disk, 
respectively,  of  Fig.  5.  Then,  Fig.  5  shows  that  erosion  shrinks  the  set  X,  whereas  dilation 
expands  X.  The  opening  suppresses  the  sharp  capes  and  cuts  the  narrow  isthmuses  of  X, 
whereas  the  closing  fills  in  the  thin  gulfs  and  small  holes.  Thus,  if  the  structuring  element 
B  has  a  regular  shape,  both  opening  and  closing  can  be  thought  of  as  nonlinear  filters 
which  smooth  the  contours  of  the  input  signal. 

Parallel  to  the  evolution  of  all  these  morphological  operations  in  [1,2],  since  the  1960’s 
there  have  been  many  other  researchers  who  have  been  using  similar  operations  of  the 
shrink/expand  type  (or  cascades  of  shrink/expand)  for  digital  (binary)  image  processing 
and  with  cellular  array  computers  designed  for  image  analysis.  Surveys  of  these  approaches 
can  be  found  in  [21,33].  In  addition  to  its  original  contributions,  mathematical  morphology 
formalized  all  the  above  collections  of  image  operations. 

Figure  6  shows  examples  of  dilations  and  erosions  of  discrete  sets.  It  also  illustrates 
the  difference  between  Minkowski  addition/subtraction  and  dilation/erosion,  respectively. 
Of  course,  there  is  no  difference  between  these  two  pairs  of  operations  if  B  is  symmetric. 
Discrete  erosions  and  dilations  accept  simple  parallel  implementations.  From  (14)  and  (15), 
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the  erosion  or  dilation  of  X  by  B  is  equal  to  the  set  intersection  or  union ,  respectively,  of 
all  translates  Xt,  of  X,  where  the  vector  b  sweeps  B‘.  Using  this  property,  Sternberg  [34] 
suggested  parallel  computer  architectures  to  implement  the  SP  erosion  and  dilation  filters, 
which  actually  involve  parallel  logical  AND’s  and  OR’s  between  binary  image  planes.  We 
discussed  the  computational  complexity  of  these  implementations  in  [20,22].  In  [32]  we 
also  give  an  alternative  non-parallel  implementation  for  the  SP  erosion  and  dilation  using 
linear  convolution  concepts. 

з. 2  Umbra  Interpretation  of  FP  Morphological  Filters 

The  four  morphological  SP  filters  can  also  be  used  for  functions  by  viewing  the  morpholog¬ 
ical  FP  filters  as  special  cases  of  SP  filters  that  process  the  umbrae  or  cross-sections  of  the 
input  functions.  The  most  general  case  of  a  morphological  transformation  of  a  function 
/  is  the  transformation  of  U(f)  by  a  structuring  element  B  that  is  a  compact  subset  of 
E.  For  example,  if  /  is  a  1-D  function,  B  could  be  a  2-D  disk,  such  as  the  one  shown  in 
Fig.  7a.  In  general,  B  is  a  set  of  the  same  or  lower  dimensionality  than  that  of  f/(/),  but 
not  necessarily  a  function.  Thus,  Minkowski  addition  f  ©  B  and  subtraction  f  ©  B  of  the 

и. s.c.  m-D  function  /  with  a  compact  (m  +  I)-D  set  B  can  be  defined  [2]  by  finding  their 
respective  umbrae: 

U{f  ©  B)  =  U{f)  ©  B  =  U{f)  0  U{B)  (19) 

u{feB)  =u{f)QBr  =  u{f)e{u{B)Y  (20) 

where  Br  =  {(x5—  t)  6  D  x  V  :  (x,t)  €E  B }  is  the  reflected  set  of  B  with  respect  to  D. 
Thus  transforming  U(f)  by  B  is  equivalent  to  transforming  U(f )  by  U(B). 

Sternberg  [6,7]  investigated  the  morphological  filtering  of  2-D  graytone  images  by 
isotropic  3-D  compact  sets  such  as  spheres,  cones,  paraboloids,  and  cylinders.  In  this 
paper,  however,  we  focus  on  only  two  special  cases  for  B.  First,  B  becomes  the  graph  of 
an  m-D  u.s.c.  function  g  with  compact  region  of  support,  as  shown  for  example  in  Fig.  7b, 
and,  hence,  we  transform  U(f )  by  the  umbra  of  g.  We  shall  call  this  case  a  morphological 
filter  of  a  function  f  by  a  ( structuring )  function  g.  Second,  B  becomes  an  m-D  compact 
set  S  lying  at  t  =  0,  as  Fig.  7c  shows.  In  this  case,  transforming  U[f)  by  S  is  equivalent 
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to  transforming  U(f)  by  the  umbra  of  S,  which  is  a  half-infinite  solid  of  top  S  formed  by 
the  Minkowski  sum  of  S  and  the  negative  t-axis.  We  henceforth  call  this  case  a  morpho¬ 
logical  filter  of  a  function  f  by  a  (structuring)  set  S.  Transforming  /  by  a  set  5CD  is  a 
special  case  of  transforming  /  by  a  function  g.  That  is,  if  g  is  fiat  (binary),  then  it  can  be 
represented  by  a  set  S. 

Concluding,  (19)  and  (20)  geometrically  interpret  the  erosion/dilation  of  a  function  / 
by  a  function  g  or  by  a  set  S  as  the  erosion/dilation  of  the  umbra  of  /  by  the  umbrae  of-gr 
or  S,  respectively.  In  what  follows,  we  will  analytically  define  the  morphological  filters  of 
a  function  by  a  structuring  function  or  set. 

3.3  Morphological  Filters  of  Functions  by  Sets 

These  are  FSP  filters  where  the  input  signals  are  m-D  u.s.c.  functions  and  the  structuring 
elements  are  compact  n-D  sets  with  n  <  m.  Their  analysis  is  easy,  since  they  commute 
with  thresholding  because  of  their  construction.  For  example,  if  $  is  the  SP  erosion  filter 
by  B,  then  [2]  defines  a  FSP  erosion  by  B  as  follows.  Since  $  is  increasing  and  u.s.c.,  for 
any  input  function  /,  the  set  class  ($[Xt(/)]  =  Xt(f )  0  B‘  :  t  €  V}  satisfies  (2)  and  (3) 
and,  hence,  through  (4)  it  creates  an  output  function  h  by  setting  Xt(h)  —  $[Xj(/)].  This 
output  function  is  the  erosion  of  f  by  B,  denoted  by  /  ©  Bs .  Likewise,  we  can  define  the 
dilation  f  ®BS,  the  opening  /#,  and  the  closing  fB  of  an  u.s.c.  function  /  by  a  compact  set 
B.  Below  we  give  their  analytical  definitions,  which  show  how  these  filters  operate  both 
on  the  function  /  as  a  whole  and  on  each  one  of  its  cross-sections: 


CROSS-SECTIONS  (all  t) 

FUNCTIONS 

xt{feB’)  =  xt(f)  eBa  «=► 

(/  eBe)(x)  =  inf  {/(y)> 

tl€Bx 

(21) 

Xt(f®Bs)  =  Xt{f)  ®B‘  «=► 

(/  0  B‘){x )  =  sup {/(y)} 

(22) 

yen  i 

xt(fB)  =  [xt(f)}B 

(/*)(*)  = 

(23) 

Xt(fB)  =  lMf))B  *=> 

(/s)W  =  [(/ffiS')eBl(i) 

(24) 

Thus,  the  erosion  (resp.  dilation)  of  /  by  B  at  any  point  x  is  obtained  by  shifting  the  set 

B  to  location  x  and  taking  the  infimum  (resp. 

supremum)  of  /  inside  this  shifted  set. 

This 

structuring  set  B  plays  the  same  role  as  a  moving  window. 
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For  sampled  signals,  the  set  B  is  discrete;  B  must  also  be  compact.  Hence,  in  the 
discrete  case,  B  is  a  finite  set  (window).  Therefore,  erosion  (resp.  dilation)  of  a  sampled 
m-D  function  by  a  finite  set  B C  Zm  is  equal  to  the  moving  local  minimum  (resp.  maximum) 
of  the  function  inside  the  window  B.  The  erosion  or  dilation  of  the  characteristic  function  of 
a  set  shrinks  or  expands  respectively  the  set.  The  correspondence  between  shrink/expand 
of  binary  images  and  local  min/max  of  gray  tone  images,  as  well  as  the  commuting  of 
min/max  with  thresholding,  was  proven  in  [9]  and  later  used  in  [5]. 

Figure  8  shows  some  examples  of  morphologically  filtering  a  1-D  sampled  function  /  of 
80  samples  by  a  small  convex  set  B  —  {— 2,  —  1, 0, 1, 2}.  We  see  that  erosion  of  a  function 
by  such  a  set  reduces  the  peaks  and  enlarges  the  minima  of  the  function.  The  dilation 
of  /  by  B  increases  the  valleys  and  enlarges  the  maxima  of  the  function.  Figure  8  shows 
that  the  opening  by  B  smooths  the  graph  of  /  from  below  by  cutting  down  its  peaks.  The 
closing  smooths  the  graph  of  /  from  above  by  filling  up  its  valleys.  Subtracting  from  / 
its  opening  or  closing  by  B  gives  the  peaks  and  valleys,  respectively,  of  /.  The  width  of 
these  peaks  and  valleys  depends  on  the  size  of  B.  Thus,  opening  and  closing  of  functions 
by  sets  can  be  used  for  detection  of  peaks  and  valleys  in  signals.  In  addition,  opening 
and  closing  by  a  convex  set  B  can  be  used  effectively  to  suppress  impulse  noise  in  signals 
[2,5,9,14,21,20].  By  impulse  noise  is  meant  that  a  signal  is  corrupted  by  impulses  (spikes), 
i.e.,  very  large  positive  or  negative  values  of  short  duration.  Opening  or  closing  by  B  can 
eliminate,  respectively,  such  positive  or  negative  noise  impulses,  if  the  impulse  width  does 
not  exceed  the  size  of  B. 

3.4  Morphological  Filters  of  Functions  by  Functions 

These  are  FP  filters  where  the  input  signal  is  an  m-D  u.s.c.  function  /  and  the  structuring 
element  is  a  n-D  u.s.c.  function  g  (n  <  m)  with  a  compact  region  of  support.  A  cross- 
section  interpretation  of  such  filters  can  be  found  in  [2].  Here,  we  limit  our  discussion  only 
to  an  umbra  interpretation  [2[.  That  is,  if  we  replace  B  with  U{g)  in  (19),  the  Minkowski 
sum  of  U(f)  and  U(g)  gives  the  umbra  of  the  Minkowski  function  addition  /  ©  g  of  /  and 
g.  (See  [35]  for  a  proof.)  The  Minkowski  function  subtraction  /  ©  g  of  g  from  /  is  defined 
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similarly.  Thus  from  (8),  (19),  and  (20)  we  have,  for  each  i£D, 


=  sup  {f(y)  +g(x-y)} 
y  6  D 

(25) 

{feg){x) 

=  inf{f{y)-9{x-v)} 

ye  D 

(26) 

The  u.s.c.  functions  may  be  real-valued  only  on  a  subset  of  D.  However,  for  each  x  6  D 
f(x)  —  sup[vl(x)],  where  A(x)  —  {i  G  V  :  x  €  If  f\x o)  ^  V  for  some  x0  6  D, 

then  we  can  still  define  /( xq )  =  sup[A(io)  =  0]  =  — oo.  If  A(X0)  =  V,  we  define 
f(x o)  =  sup(V)  =  +oo.  Thus  we  can  assume  that  /  and  g  are  defined  over  all  D.  We 
call  the  region  of  support  of  such  a  function  /,  denoted  by  Ros(f),  the  subset  of  D  on 
which  f(x)  ^  — oo.  For  the  morphological  filtering  of  /  by  g  to  be  an  u.s.c.  filter,  it  is 
sufficient  that  Ros(g)  be  a  compact  ( finite ,  for  sampled  signals)  subset  of  D. 

The  relation  between  Minkowski  subtraction/addition  and  erosion/dilation,  respec¬ 
tively,  of  functions  is  the  same  as  for  sets.  That  is,  if  gr'(x)  =  ff(— x)  denotes  the  symmetric 
function  of  g  with  respect  to  the  origin,  Serra  [2]  defines: 


Erosion  of  /  by  g 

(f  9  ff')(x)  =  f(x)  Qg(-z) 

(27) 

Dilation  of  /  by  g 

(f&g')(x)  =  f(x)  ©ff(-x) 

(28) 

Opening  of  f  by  g 

fgix)  =  [{f  9  g')  ©s](x) 

(29) 

Closing  of  /  by  g 

f8{x)  =  [(/©£')  ©ff](x)  • 

(30) 

Thus  the  Minkowski  sum  of  /  and  g  is  defined  through  an  additive  convolution  between 
/  and  g  and  then  taking  a  supremum,  as  opposed  to  summation  or  integration  for  lin¬ 
ear  convolutions.  Likewise,  the  Minkowski  subtraction  of  g  from  /  is  defined  through 
a  subtractive  convolution  between  /  and  g  and  then  taking  an  infimum.  We  shall  call 
the  Minkowski  addition  and  subtraction  of  two  functions  morphological  convolutions. 
From  (25)  and  (28)  we  see  that  the  relation  between  Minkowski  function  addition  and 
dilation  is  the  same  as  between  convolution  and  correlation  of  two  functions,  respectively; 
likewise  for  Minkowski  function  subtraction  and  erosion.  Thus,  we  shall  call  the  dilation 
and  erosion  of  two  functions  morphological  correlations.  Of  course,  if  g(x)  =  g(- x)  is 
even,  the  above  difference  disappears,  because  then  /  ©  g  =  /  ©  g’  and  /  ©  g  =  /  ©  g! ■ 
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The  morphological  filtering  of  a  function  /  by  a  set  B  is  a  simple  case  of  filtering  /  by 
a  function  g.  That  is,  if  g(x)  =  0  for  all  x  E  Ros(g),  then  (27)-(30)  reduce  respectively 
to  (2l)~(24)  by  setting  B  =  Ros(g).  The  difference  between  a  binary  and  a  multilevel 
structuring  function  g  is  also  depicted  in  Fig.  9.  Consider  a  cosine  function  f(x)  =  coswx, 
x  E  R,  and  a  structuring  function 

.A[cos(u;x)  —  cos(wL)] 

-00  ,  ||  x  ||>  L 

where  ||  •  ||  denotes  absolute  value,  0  <  A  <  1,  and  0  <  L  <  7r/(2w).  Thus  g(x)  is  a 
scaled  top  of  the  cosine.  If  A  =  0,  g  is  binary;  if  A  >  0,  g  is  multilevel.  Figure  9a  shows 
the  opening  fg  for  three  different  structuring  functions  corresponding  to  three  different 
values  of  A  =  0, 0.5,1.  If  A  =  0,  the  FP  opening  ft  reduces  to  the  FSP  opening  /#, 
where  B  —  Ros(g )  =  [— L,  L\.  This  opening  cuts  down  the  peaks  of  the  cosine.  We  can 
symmetrize  this  by  considering  the  open-closing  (opening  followed  by  closing  by  the  same 
structuring  function)  (fg)g  shown  in  Fig.  9b.  Similar  results  can  be  observed  if  we  consider 
the  clos-opening  (closing  followed  by  opening  by  the  same  structuring  function)  ( fa)g . 
(The  open-closing  and  clos-opening  are  new  morphological  filters  introduced  in  [20]  and 
used  for  image  noise  suppression  and  for  providing  fixed  points  of  median  filters;  see  also 
[32].)  For  A  =  0  the  FSP  open-closing  cuts  down  the  peaks  and  fills  up  the  valleys  of 
/.  This  clipping  effect  of  the  open-closing  is  very  similar  to  the  behavior  of  the  analog 
median  filter  [36].  Figures  9a, b  (A  ^  l)  suggest  that  opening  and  open-closing  have 
both  “low-pass”  and  “high-pass”  filtering  characteristics.  Indeed  both  attenuate  the  basic 
frequency  u  of  f  and  introduce  higher  haxmonics;  the  opening  also  introduces  a  dc-offset 
[20].  However,  the  frequency  analysis  of  the  effects  of  opening  or  closing  is  of  very  limited 
importance,  because  these  effects  are  dependent  on  the  input  signal,  and  they  cannot  be 
generalized  since  linear  superposition  does  not  apply.  Of  general  importance,  though,  is 
the  following  geometric  interpretation  that  we  give  for  the  opening. 

For  any  functions  /  and  y,  the  umbra  of  the  opening  fg  is  equal  to  the  union  of  all  the 
translates  of  U(g)  that  can  “fit”  inside  U(f);  i.e.,  for  z  =  (y,c)  E  D  x  V, 

U{ft)  =  U  [U{g)]z  <=>  fg{x)  =  sup  {y(x-y)  +  c}  (31) 

[t/(,)l,Cn(/)  M»-*)+«l</M 
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A  similar  geometrical  interpretation  can  be  given  for  the  closing  by  g ,  since  ( fa )  —  —  {—fg)- 
For  example,  in  Fig.  9  the  closer  A  is  to  one,  the  more  g  resembles  the  cosine  peak,  the 
closer  the  fitting  of  g  under  the  peaks  or  above  the  valleys  of  /,  and  hence  the  closer  fg 

or  ( fa)9  is  toward  /.  In  the  limit  when  A  —  1,  g  becomes  equal  to  the  cut-off  cosine  peak, 

and  both  fg  and  ( fa)a  are  equal  to  /  for  all  L  <  7r/(2a>). 

Next  we  provide  some  examples  of  discrete  FP  morphological  filtering.  Figure  10  shows 
a  1-D  original  sampled  function  representing  250  samples  of  a  graytone  image  intensity  pro¬ 
file  (after  the  addition  of  a  dc-offset);  its  median  filtered  version  by  an  11-point  window; 
and  its  filtered  versions  by  six  morphological  filters  (erosion,  dilation,  opening,  closing, 
open-closing,  and  clos-opening),  each  operated  by  three  differently  shaped  discrete  struc¬ 
turing  elements  with  a  convex  11-point  region  of  support.  The  first  structuring  element  is 
a  set  B,  and  the  other  two  are  functions  g,h: 

B  =  {n  e  Z  :  -5  <  n  <  5} 
g(n)  =  G  •  v/25  -  n2"  ,  -5  <  n  <  5 

h{n )  =  H  •  (25  -  n2)  ,  -5  <  n  <  5  , 

and  g(n)  =  h[n )  =  — oo  if  ||  n  ||>  5.  In  Fig.  10  the  scaling  factors  of  g  and  h  were  G  =  5 
and  H  —  2.  The  umbra  U{B )  is  a  semi-infinite  rectangle  of  top  B,  and  (if  G  —  H  =  l) 
U(g)  and  U(h )  are  the  umbrae  of  a  disk  and  a  parabola,  respectively.  As  explained  in 
Section  3.2,  morphological  filtering  of  /  by  B,g,h  results  in  a  function  whose  umbra  is 
identical  to  the  umbra  resulting  from  morphological  filtering  of  U(f)  by  U(B),U(g),U(h). 
Therefore,  in  Fig.  10  we  called  these  three  cases  filtering  by  “rectangle,  disk,  parabola”, 
respectively.  The  following  qualitative  observations  are  evident  from  Fig.  10:  l)  The 
erosion  and  dilation  produce,  respectively,  a  smaller  (with  respect  to  function  <)  and 
larger  function.  2)  The  opening  or  closing  by  a  rectangle  produce  signals  whose  peaks  or 
valleys,  respectively,  consist  of  flat  plateaus  not  smaller  than  the  size  of  the  rectangle  top; 
this  flatness  increases  with  the  size  of  the  rectangle  top.  They  also  preserve  the  vertical 
boundaries  of  the  signal  they  transform  and  commute  with  thresholding.  3)  Morphological 
filtering  by  g  or  h  does  not  commute  with  thresholding  and  tends  to  shape  the  original 
signal  /  similarly  to  the  shape  of  g  or  h.  Specifically,  opening  or  closing  by  g  and  h  tends 
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to  penetrate  inside  the  peaks  or  valleys  of  /.  The  amount  and  shape  of  this  penetration 
depends  on  the  amplitude  range,  support  width,  and  shape  of  g  and  h.  Thus  the  parabola 
h  penetrates  more  than  the  disk  g  since  it  has  a  narrower  and  sharper  shape.  4)  Both 
the  open-closing  and  clos-opening  offer  a  balanced  mixing  of  the  properties  of  opening  and 
closing,  and  they  transform  /  very  similarly  to  the  median  (see  also  [20,32]).  Finally,  the 
original  function  in  Fig.  10  was  selected  1-D  for  an  easier  visualization  of  the  geometrical 
effects  of  morphological  filtering,  but  the  above  observations  are  general  and  apply  to 
signals  of  higher  dimensionality  too. 

The  principal  point  of  the  above  discussion  and  examples  is  that,  for  an  intuitive 
understanding  of  morphological  filtering,  any  structuring  function  g  should  be  seen  first  as 
a  geometrical  pattern.  For  instance,  (31)  implies  that  the  opening  of  a  signal  by  g  is  the 
geometrical  (inclusive)  content  of  the  signal  in  this  pattern  g.  Thus,  if  the  signal  is  not 
smooth  and  g  is  smooth,  then  the  opening  by  g  will  be  smoother  than  the  original  signal. 
However,  if  the  signal  is  smooth  and  g  is  less  smooth,  then  the  opening  by  g  may  be  less 
smooth  than  the  original  signal. 

3.5  Properties  of  Morphological  Filters 

Some  properties  of  arbitrary  SP  and  FP  filters  are  defined  in  Table  II.  Referring  to  these 
definitions,  both  SP  and  FP  erosions,  dilations,  and  all  their  cascades  (e.g.,  opening, 
closing,  open-closing,  and  clos-opening)  or  parallel  combinations  (using  n(u)  for  sets  or 
pointwise  A  (v)  for  functions)  are  translation-invariant  and  increasing  filters.  Further,  if 
0  denotes  the  origin  of  D,  we  have: 

Property  1.  Ordering.  The  opening  is  always  anti- extensive  filter  (fg  <  /),  whereas 
the  closing  is  always  extensive  (fa  <  /).  If  <7(0)  >  0,  then  the  erosion  by  g  is  anti-extensive, 
whereas  the  dilation  by  g  is  an  extensive  filter.  Thus,  if  <7(0)  >  0, 

/©?</,  </</*</©?•  -  (32) 

Proof.  If  <7(0)  >  0,  Vx  £  D,  /  ©  g(x)  =  inf{/(z)  -  g(x  —  2)  :  z  E  D}  <  f(x)  -  ff(0)  < 
/(x)  =>  /  0  g  <  /.  Likewise,  /  ©  g  >  /. 
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From  (27), (28), (29),  and  Vy,  fa{x)  -  supz{inftf{/(y)  -  g(y  -  z )}  +  g{x  -  z )}  =► 
fs(x)  <  inf{sup{/(y)  -  g{y  -  z)  +  g{x  -  z)}}. 

V  z 

(See  also  [29,  p .43 j .)  Selecting  y  —  x  in  the  above  inequality  yields:  fa  (i)  <  sup ,{/(*)}  = 
f(x)  =r*  fg  —  f.  Likewise,  fa  >  f  can  be  proved.  Q.E.D. 

Property  1  also  holds  for  SP  filters.  That  is,  XB C  XC  Xb  for  any  sets  X,  B\  moreover, 
if  0  G  B,  XeBQ  XBC  XC  XbQX®B.  The  validity  of  Property  1  can  be  observed' in 
Fig.  5  for  SP  filters  and  in  Fig.  10  for  FP  filters. 

The  SP  and  FP  opening  and  closing  are  idempotent ;  i.e.,  ( fa)g  =  fa  and  ( / 9)9  =  fg. 
Similarly  we  have: 

Property  2,  The  SP  and  FP  open-closing  and  clos-opening  filters  are  idempotent. 

Proof.  SP  open-closing:  Let  Y  =  ( XB)B .  Then  Y  =  7B  D(Yb)B  =  [{{XB)B)B}B  D[(Xb)b]b 
Y  ==>■  Y  =  (Yb)b.  Similarly  we  prove  that  the  SP  clos-opening  ( XB)B  is  idempotent.  By 
replacing  X  with  a  function  /,  B  with  a  structuring  set  or  function,  and  set  C  with 
function  <,  the  property  is  proved  for  functions  too.  Q.E.D. 

Equations  (14), (15)  and  (16), (17)  imply  that  there  is  a  duality  with  respect  to  set  com¬ 
plementation  between  set  erosion  and  dilation  as  well  as  between  set  opening  and  closing. 
Likewise,  there  is  a  duality  with  respect  to  function  negation  between  the  corresponding 
FP  filters.  That  is,  (— /)  Qg  =  —  (/ ©  y)  and  {—f)e  —  —  {f9),  where  (— f)(x)  —  —f(x) 
for  all  x.  More  details  about  properties  of  SP  filters  can  be  found  in  [2,22].  Henceforth, 
we  will  focus  only  on  some  properties  of  FP  morphological  filters. 

Dilation  of  /  by  g  is  both  commutative  and  associative.  Erosion  is  neither  commutative 
nor  associative.  Moreover,  we  have: 

Property  3.  Distributivity.  (/Vy)©h  =  (/©/i)v(y©/i)  and  (/  Ay)  Qh  =  (/ Qh)  A  (y  ©/i). 
Property  4.  Parallel  Composition,  f  ©  (y  V  h)  =  (/  ©  g)  A  (/  0  h). 

Property  5.  Serial  Composition.  (/  ©  g)  ©  h  =  /  ©  (y  ©  h)  and  (fQg)Qh  —  fQ(g®h). 

The  proofs  of  Properties  3,4,5  result  from  interchanging  sup/inf  with  max/min,  respec¬ 
tively,  and  other  similar  properties  of  sup/inf.  Properties  3,4,5  also  hold  for  FSP  erosions 
and  dilations  of  functions  by  sets  if  we  replace  the  g  V  h  or  g  A  h  of  two  functions  by  the 
union  A  U  B  or  intersection  An  B,  respectively,  of  two  sets. 


23 


Property  5  makes  erosion  and  dilation  inherently  separable  filters.  For  example,  the 
erosion  of  a  2-D  set  or  function  by  the  discrete  3  x  3-pixel  set  B  of  Fig.  6e,  can  also  be 
obtained  by  eroding  first  by  B\  (the  3-pixel  horizontal  segment)  and  then  eroding  the 
result  by  JE?2  (the  3-pixel  vertical  segment),  because  B  =  Bi  ®  J92.  Thus,  this  2-D  erosion 
becomes  a  cascade  of  1-D  erosions. 

Difference  between  structuring  function  and  set.  The  difference  in  geometrical 
effects  between  opening  (or  closing)  of  a  function  by  a  binary  and  multilevel  structuring 
function  can  be  seen  in  Figs.  9,10.  Next  we  quantify  analytically  this  difference. 

Property  6.  If  g  is  a  bounded  real-valued  structuring  function  with  a  compact  region 
of  support  B  —  Ros(g'),  then,  for  any  function  /,  Vi  G  D, 

II  /,(*)  -  /b{x)  ||<  sup{y(z)}  -  inf  (ff(z)}  .  (33) 

zeB 

Proof.  Both  s  =  sup{<7(z)  :  z  €  B}  and  r  =  inf{ff(z)  :  z  6  B}  are  are  real  numbers 
because  g  is  bounded.  Then,  fa[x)  =  sup{/  0  <p(z)  +  g[x  —  z)  :  z  G  D}  ==>•  f„[x)  < 
s+sup{fQgs{z)  :  z  €  (£*)*}.  Also,  fQg‘{z)  =  inf{/(y) -g[y~z)  :  y  6  Bz}  <  fQB’(z)-r. 
Thus,  fg(x)  <  sup {fQBs(z)  :  z  €  (-B*)x}  +  s  —  r  =  /b{x)  +  s  —  r.  Likewise,  we  can  prove 
that  fg(x)  >  /b(i)  —  s  +  r,  and  the  proof  is  complete.  Q.E.D. 

The  result  (33)  applies  also  to  the  closing  of  /  by  g  since  fg  =  —(—/),.  For  sampled 
signals,  the  sup/inf  of  g  over  the  compact  Ros(g)  =  B  become  the  max/min  of  g  over 
the  finite  Ros(g).  For  example,  referring  to  the  original  function  /  and  the  structuring 
elements  B,g,h  of  Fig.  10,  ||  fg{x)  —  fs{x)  ||<  25  and  ||  fh[x)  —  /b{x)  ||<  50  for  each  x. 

Fixed  points  of  opening  and  closing  by  a  structuring  function.  In  [1,11]  it 
was  shown  that  the  opening  and  closing  filters  can  be  completely  specified  from  their 
fixed  points,  i.e.,  signals  invariant  to  these  filters.  The  interest  in  the  fixed  points  of  the 
openings  and  closings  also  arises  from  their  direct  relations  to  the  fixed  points  of  median 
filters  [20,32].  The  following  theorem  classifies  the  fixed  points  of  the  FP  opening  and 
closing  filters.  (A  proof  of  a  similar  theorem  for  SP  openings/closings  can  be  found  in  [2].) 

THEOREM  5  .  A  function  f  is  a  fixed  point  of  the  opening  ( resp .  closing)  filter  by  a 
function  g  iff  f  =  /i©g  (resp.  f  =  hQg),  where  h  is  an  arbitrary  function.  Likewise,  for 
any  set  B,  f  —  fB  <=>  f  =  h®B  and  f  =  fB  <=>  f  =  hQB,  for  some  function  h. 
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Proof.  If  /  —  fg,  then  we  simply  set  h  =  f  0  g‘.  Conversely,  if  /  =  h  ©  g  for  some 
function  h,  from  Property  1  and  since  dilation  is  increasing  filter, 

hQg  >  (h  ©  g)a  =  [(/i  ©  g)  0  £*]  ©  g  =  h9'  ©  g  >  h  ©  g  . 

Thus,  fg  —  (h  ©  g)g  =  h  ©  g  =  / .  Likewise  for  the  closing,  if  /  =  /tf,  we  set  h  —  fQg3. 
Conversely,  if  /  =  hQg, 

hQg  <  ( hQg)9  =  =  hs.Qg  <  hQg  . 

Thus  f3  =  ( hQg)3  =  hQg  =  f.  Nothing  also  changes  in  the  proof  if  we  replace  g  with  B 
(and  hence  ga  with  B3).  Q.E.D. 

Invertibility  of  erosion  and  dilation.  In  general,  erosion  and  dilation  are  nonin- 
vertible  operations.  However,  from  the  erosion  of  /  by  g  we  can  recover  the  original  /  iff 
f  —  fg.  Specifically,  since  (/  ©  g‘)  ©  g  —  fB,  the  Minkowski  sum  of  the  erosion  /  Qg3  and  g 
recovers  /  iff  /  =  fB.  Likewise,  if  we  have  the  dilation  /  ffiff*  and  we  Minkowski  subtract  g 

from  it,  we  obtain  (/  ©  g3)  ©  g  —  f9.  Thus,  if  /  =  fa,  Minkowski  subtraction  of  g  from  the 

dilation  /  ©  g3  recovers  the  original  /.  However,  in  the  general  case,  where  fB  ^  ^  f3, 

we  have: 

Property  7.  If  <7(0)  >  0,  then 

fa  <h<  f  =>  hQg3  =  f  Qg3  =>  hB  =  fg  ,  (34) 

f  <h<f9  =>  h  ®  g3  =  f  @  g3  ^h9  =  f9  .  (35) 

Proof.  For  any  /  and  g,  because  of  Theorem  5, 

/,©**  =  [(/ © g')  © g]eg'  =  ( feg Y  =  feg’  ■ 

Since  ^(0)  >  0,  the  erosion  by  g  is  increasing  filter.  Hence,  fB  <  h  <  f  =>  fgQg*  < 
hQg 3  <  f  Qg3  =>  hQg3  =  fQg3  =>  hB  =  fB.  Similarly, 

f9®g3  =  [(/®^s)©ff]©ff*  =  (f®g3)s-  =  f®ga  • 

Since  g(0)  >  0,  the  dilation  by  g  is  increasing  filter.  Hence,  f  <  h  <  f9  =>  fQg3  < 
hQg3  <  f9@g3  =>  hQg3  -  fQg3  =>  h9  =  f9.  Q.E.D. 


25 


Thus,  in  the  general  case  when  /  ^  fa ,  from  the  erosion  f  Q  g‘  we  cannot  recover  /, 
because  there  is  not  a  unique  function  whose  erosion  by  g  is  equal  to  fQg *.  Furthermore, 
the  Minkowski  sum  of  /  ©  ga  and  g  will  recover  only  the  function  fa,  but  none  of  the 
functions  h  between  /  and  ft.  Likewise,  if  /  ^  /s,  the  dilation  of  /  by  g  cannot  be 
inverted. 


4  RELATIONS  BETWEEN  LINEAR  AND  MOR¬ 
PHOLOGICAL  FILTERS 

A  linear  shift-invariant  (LSI)  filter  is  viewed  in  our  analysis  as  a  FP  filter  that  commutes 
only  with  a  shift  with  respect  to  the  argument  of  its  input  functions.  A  linear  translation- 
invariant  (LTI)  filter  (see  Table  II)  is  a  LSI  filter  that  passes  constant  signals  unchanged, 
viz.,  whose  dc-gain  is  equal  to  one.  Now  suppose  that  a  LTI  filter  ip  is  defined  on  a  class 
7  of  real-valued  u.s.c.  functions  that  is  closed  under  translation.  This  class  7  could  be, 
for  instance,  the  class  of  continuous  functions,  or  the  class  of  bounded  functions,  or  the 
class  of  functions  with  a  compact  region  of  support.  Let  h(x),  x  E  D,  denote  the  impulse 
response  of  ip.  Then,  ip{f)  =  h  *  f  for  any  f  E  7,  where  denotes  linear  convolution, 
discrete  or  continuous.  The  kernel  of  ip  is  defined  as  the  following  set  of  input  functions: 

K(ip)  =  {gE7  :  h*g( 0)  >  0}  .  (36) 

The  above  kernel  uniquely  characterizes  the  LTI  filter  ip  and  can  reconstruct  it,  as  explained 
in  Maragos  [20,  chap. 5],  because  Vz  E  D 

[W)]^)  =  SUP0  eH:[f(x  +  z)  -t]E  K(ip)}  .  (37) 

In  addition,  if  ip  is  also  increasing ,  then  it  can  be  represented  exactly  as  the  supremum 
of  erosions  by  all  its  kernel  functions.  The  following  theorem  provides  a  necessary  and 
sufficient  condition  for  a  LSI  filter  to  be  increasing. 

THEOREM  6  .  A  linear  shift-invariant  filter  is  increasing  iff  its  impulse  response  is 
nonnegative  everywhere. 
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Proof.  Let  h(x ),  x  G  D,  be  the  impulse  response  of  the  LSI  filter.  Sufficiency:  Let 
h{x)  >  0  Vx.  If  f  <  g,  then  p(x)  =  g(x)  —  f(x)  >  0  Vx  =>  h*  p(x)  >  0  Vx  =>•  h*g  >  h*  f. 

Necessity:  Let  h*  f  <  h*  g  for  any  /  <  g.  Then,  h  *  p(x)  >  0  Vx,  if  p{x)  is  any  function 
with  p(x)  >  0  Vx.  l)  Discrete  Filters.  Let  the  nonnegative  function  p(n.),  n  G  Zm,  of  the 
previous  discussion  be  equal  to  the  discrete  unit  impulse  <5(n).  Then  h(n)  —  h(n)*6(n)  >0 
Vn.  2)  Analog  Filters.  Express  the  Dirac  unit  impulse  function  as  the  limit  S(x)  — 
lim[pt(x)]  for  k  — *  oo,  where  pfc(x),  x  G  D  =  Rm,  is  a  nonnegative  triangular  pulse  whose 
width  goes  to  zero  and  height  goes  to+ooasA:— >  oo  in  a  way  such  that  fD  pk[x)dx  =  1 
for  all  k.  Then,  if  k  -*  oo,  Vx,  h(x)  =  fD  h(z)6(x  -  z)dz  =  fD  h(2)[limp*:(x  -  z)]dz  = 
lim[/D  h(z)pk(x  —  z)dz\  >  0,  because  h  *  p*(x)  >  0  since  Pk[x)  >  0  V/c,  Vx.  Q.E.D. 

For  the  analysis  in  this  section  we  also  need  the  following 

THEOREM  7  (Maragos  [20,  p,126j).  Any  translation-invariant  and  increasing  FP  filter 
defined  on  a  class  of  u.s.c.  functions  closed  under  translation  can  be  represented  exactly 
as  the  supremum  of  erosions  by  all  its  kernel  functions. 

Theorems  6  and  7  prepared  the  groundwork  for  the  first  representation  of  linear  con¬ 
volutions  using  morphological  correlations.  Formally,  we  have 

THEOREM  8  .  Let  if  be  a  linear  shift-invariant  filter  defined  on  a  class  7  of  u.s.c. 
functions  closed  under  translation.  Let  also  its  impulse  h(x)  satisfy  the  following  two 
conditions: 

(a)  h(x)  >  0  for  all  x  G  D  =  Rm  (or  Zm), 

(b)  [  h{x)dx  =  1  (or  Y2  h(n)  =  l). 

jRm  n€Zm 

Then  if  is  exactly  represented  as  the  supremum  of  erosions  by  all  its  kernel  functions 
g  G  K(rf);  thus,  for  any  f  G  7  and  x  G  D, 

(h*/)(x)=  sup  {  inf  {/(z)  —  g(z  —  x)}}  (38) 

geK(if)  zGD 

Proof,  if  is  increasing  because  of  Theorem  6  and  condition  (a).  Condition  (b)  makes  if 
translation-invariant.  Thus  Theorem  7  completes  the  proof  of  (38).  Q.E.D. 
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For  linear  convolutions  with  h( z)  we  assume  that  h(x)  =  0  iff  z  ^  Ros(h),  whereas  for 
morphological  convolutions  with  the  structuring  function  g(x)  we  assume  that  g(x)  =  —  oo 
iff  z  ^  Ros(g).  Thus,  when  the  input  function  /  is  linearly  convolved  with  h  in  (38),  we 
assume  that  /(z)  =  0  outside  Ros(f).  However,  when  /  is  morphologically  convolved  with 
<7,  we  assume  that  /(z)  =  —  oo  outside  Ros(f). 

Theorem  8  may  have  some  theoretical  interest,  but  its  practicality  is  rather  small 
because,  in  general,  it  is  not  a  simple  task  to  analytically  find  and  describe  all  the  (infinite 
in  number)  kernel  functions  that  (38)  requires.  Our  goal  then  is  to  find  a  subset  of  the  kernel 
which  is  mathematically  more  tractable  and  can  still  represent  the  filter.  We  summarize 
below  our  approach.  (The  complete  theoretical  analysis  is  contained  in  [20].)  The  kernel 
of  the  LTI  filter  ip,  equipped  with  the  function  ordering  <,  becomes  a  partially  ordered 
set  (a  poset).  A  minimal  element  of  the  poset  (K.(ip),<)  is  a  function  g  £  K  (ip)  that 
is  not  preceded  (with  respect  to  <)  by  any  other  function  of  K(ip).  We  define  the  set 
8  (ip)  of  all  the  minimal  elements  of  K(ip)  as  the  basis  of  ip.  We  have  shown  that  the 
basis  of  any  translation-invariant,  increasing,  and  u.s.c.  filter  is  nonempty  and  can  exactly 
represent  it.  The  basis  of  such  a  filter  may  be  finite  (as  is  the  case  for  morphological, 
median,  and  order-statistic  filters  [20,13,32]),  in  which  case  the  filter  is  realized  exactly  as 
the  maximum  of  a  finite  number  of  erosions.  For  discrete  LTI  filters  a  sufficient  condition 
to  find  a  nonempty  basis  in  their  kernel  is  to  have  an  impulse  response  of  finite  extent : 

THEOREM  9  .  Let  h(n),  n  £  Zm ,  be  the  finite-extent  impulse  response  of  an  increasing 
LTI  discrete  filter  ip  which  is  defined  on  a  class  7  of  real-valued  sampled  functions  closed 
under  translation.  Then  the  basis  of  ip  is  equal  to 


B(ip )  =  {g  £  7  :  h(k)g(—k)  =  0  and  y(n)  =  — oo  ■<=>■  h(—n)  =  0}  (39) 

je€Ros(/i) 

Further,  ip  can  be  represented  exactly  as  the  supremum  of  erosions  by  all  its  basis  functions 
g  £  8(iJ)).  That  is,  for  any  f  £  7  and  n  €  Zm, 


( h*f)(n)  =  Y2  h(k)f(n-k)=  sup  {  min  {f(k)-g(k~n)}}  (40) 

jfc6Ro,(M  ,eSM 

Proof,  (a)  Basis:  Call  8  the  class  of  functions  given  by  (39),  and  let  M  be  the  true 
basis  of  ip.  We  must  show  that  M  =  8.  8  is  nonempty,  because  g*  £  S,  where  g*(n )  =  0 
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iff  h(—n)  0  and  g*(n )  =  —  oo  otherwise.  Let  now  g  G  B.  Then,  g  G  K(ip)  because 

h  *  g(0)  =  0.  Is  g  minimal?  Suppose  it  is  not.  Then  there  is  /  G  K(ip)  such  that  f  <  g 
and  f  ^  g.  Since  h(n)  >  0  Vn,  0  <  h*  /( 0)  <  h  *  g( 0)  =  0  =>  h  *  /(0)  =0.  Since  f  <  g 
and  <7(n)  =  — oo  Vn  i?os(gr),  there  exists  k  G  Ros(g)  such  that  /(A:)  <  g(fc);  this  implies 
h(—k)f(k )  <  h(-k)g(k)  and  thus  h  *  /(0)  <  h  *  g(0)  =  0:  Contradiction!  Hence,  g  G  M, 


and  thus  BC  M. 

Let  now  g  G  M.  All  the  basis  functions  g  must  have  a  minimal  region  of  support  G  = 
[J?os(/i)]a,  because  only  the  indices  n  G  G  are  required  for  g(n)  in  computing  h*g( 0).  Thus 
g  satisfies  one  of  the  two  requirements  of  (39).  Suppose  that  g  £  8.  Let  h  *  gr(0)  =  p  >  0 
and  consider  the  function  /(n)  =  g(n)  —  p,  n  G  G.  Then,  /  <  g  and  f  ^  g.  However, 
h*f(  0)  =  h*g(0)—p  —  0,  and  hence  /  is  a  kernel  function  of  x/j  that  precedes  g.  Hence,  g  is 
not  a  minimal  element:  Contradiction!  Therefore,  g  G  B,  and  thus  MC  S C  X  =>•  M  =  B. 

(b)  Representation:  Since  ip  is  translation-invariant,  increasing,  and  u.s.c.  (due  to 
the  finite  extent  of  h ),  it  can  be  represented  exactly  as  the  supremum  of  erosions  by  its 
basis  functions  [20,  p.135];  this  proves  (40).  An  alternative  proof  proceeds  as  follows: 
Let  Ros{h )  =  {ki,k2, . . .  ,kN}  be  the  iV-point  finite  region  of  support  of  /i(n).  Let  also 
hi  =  h(ki ),  f(n  —  ki)  =  /,-,  and  ff(— fc,)  =  ff,-,  with  i  =  1,2, ...  ,N  and  ki  G  Ros(h).  Then 
we  must  prove  that,  Vn, 


subject  to 


Y^hifi=  sup  {min{/,-  —  <?,•}} 

«  9eB{iP)  ' 


(41) 


hi9*  =0  ,  J2  hi  =  1  >  hi>0  . 

i  x 

For  any  n,  /,-,  t  =  1, . . . ,  N,  and  X),-  are  arbitrary  but  fixed  real  numbers.  Hence,  among 
all  functions  in  8  (ip)  we  can  always  find  a  basis  function  g *  defined  by  g*  =  g*(—ki)  = 
/«  ~  E;  h, t  =  1, . . . ,  N.  For  each  g  G  B  (ip)  there  is  a  j  <  N  such  that  fj  -  g,  <  fc  -  gi 
Vt  =►  hi(fj  -  g,)  <  hi(fi  —  gi)  Vi.  Summing  the  latter  inequality  for  all  t,  we  obtain 
fj  -  gj  =  min,{/,  -  gi}  <  Ei  hif{,  Wg  G  B  (ip).  However,  g*  achieves  this  upper  bound  since 
min,{/,-  —  g*}  =  Et  h,/,-,  and  thus  the  proof  of  (41)  is  complete.  Q.E.D. 

Thus,  if  an  increasing  LTI  discrete  filter  ip  has  a  finite  impulse  response  h,  then  its 
basis  exists,  but  it  contains  an  infinite  number  of  functions  g.  These  basis  functions  can 
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be  found  by  solving  the  linear  equation  h  *  y(0)  =  0  subject  to  three  constraints:  (1) 
h{n )  >  0,  all  n,  (2)  £n/i(n)  =  1,  and  (3)  Ros(g)  —  [iEos(h)]*.  If  Ros(h)  has  exactly  N 
points,  then  both  h  and  all  the  g's  are  vectors  inside  the  iV-D  Euclidean  space  R^.  Since, 
in  solving  h  *  <7(0)  =  0,  we  can  choose  freely  the  N  —  1  values  of  g ,  the  basis  B  is  isomorphic 
to  the  ( N  —  l)-D  vector  space  R^-1  [20].  Moreover,  B  is  the  hyperplane  of  R^  that  is 
perpendicular  to  the  vector  h,  because  h  *  g(0)  =  0  corresponds  to  a  zero  inner-product 
of  the  vectors  h  and  g.  This  is  depicted  in  Fig.  11  for  the  spaces  R^  and  R2.  In  R2,  the 
2-point  impulse  response  vector  has  only  two  components.  Because  the  filter  is  LTI  and 
increasing,  all  components  of  h  are  nonnegative  and  sum:up  to  one.  Hence,  h  is  confined 
to  move  only  along  the  line  connecting  the  points  (0,1)  and  (1,0)  in  R2.  The  basis  of  these 
filters  is  the  1-D  space  (line)  of  vectors  g  that  is  perpendicular  to  h  and  passes  through 
the  origin,  as  shown  in  Fig.  11.  The  next  two  simple  examples  clarify  these  concepts. 

Examples.  Consider  the  increasing  LTI  filter  rpi  (a  moving  average)  whose  impulse 
response  is  h(n)  =  0.5[6(n)  +  8{n  —  1)],  n  €  Z.  Its  kernel  is  equal  to  K(xl>  1)  =  {/  : 
f(n)  +  f(n  —  l)  >  0}.  Its  basis  functions  g  can  be  found  from  /i(0)fir(0)  -I-  fi(l)^(— 1)  =  0; 
hence,  g(n)  =  r[<5(n)  —  <5(n  +  1)],  r  €  R,  and  g(n)  =  —00  if  n  £  {  —  1,0}.  Thus,  from  (40), 
we  can  exactly  express  Vh  by  a  supremum  of  minima: 


0.5[/(n)  +  f(n  -  1)]  =  sup{min{/(rc)  -r,f(n-  1)  +  r}}  (42) 

reR 

for  any  input  signal  /(n).  Another  way  (independent  of  Theorem  9)  to  prove  (42)  can  be 
found  in  [20,  p.155]. 

Consider  now  a  3-point  increasing  LTI  filter  xjj2  with  impulse  response  h(n)  =  a6(n  — 
1)  +  6<5(n)  +  c6(n  +  l),  n  €  Z,  where  a  +  b  +  c  =  1  and  a,  b,  c  >  0.  Its  basis  functions  g 
satisfy  ag(-l)  +  bg(0 )  +  cff(l)  =  0;  hence,  ff(-l)  =  r  G  R,  g( 0)  =  s  G  R,  g(l)  = 
and  g(n)  =  —00  if  n  ^  {  —  1,0,  l}.  Thus  can  be  realized  by  both  linear  or  morphological 
convolutions: 


a/(n-l)+6/(n)  +c/(n  +  l) 

for  any  input  /(n). 


sup  {min{/(n-l)-  r,  /(n)—  s 
(r,i)eR 


, .  ,  ar  +  fc 

f(n  +  l)+  -» 

l  —  o  —  o 

(43) 
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Theorems  8  and  9  require  some  constraints  on  the  impulse  response  of  the  LSI  filter, 
i.e.,  nonnegativity  and  area  equal  to  one.  These  constraints  are  relaxed  by  the  following 

THEOREM  10  .  Any  LSI  discrete  (resp.  continuous )  filter  whose  impulse  response  is 
absolutely  summable  (resp.  integrable)  can  be  represented  exactly  as  the  sum  of  two  suprema 
of  erosions,  each  followed  by  a  gain  factor. 

Proof.  Assume  that  the  filter  ip  is  discrete,  because  for  continuous  filters  we  need 
only  to  replace  summation  with  integration  in  this  proof.  If  h[n),  n  €  Zm,  is  the  impulse 
response  of  ip,  then  we  can  represent  ip  as  the  sum  of  two  other  filters  ipp  and  V'w  with 
impulse  responses  hp  and  h^,  respectively,  such  that  h(n)  —  hp(n)  +  hff(n),  hp(n )  >  0,  and 
hjv(n)  <  0  for  all  n.  Since  h{n )  is  absolutely  summable,  the  two  sums  Gp  =  hp(n)  >  0 
and  Gn  =  Z)nh/v(n)  <  0  are  finite  real  numbers.  If  Gp  =  0,  hP(n )  =  0  for  all  n,  and 
ip  —  ipN .  Likewise,  if  Gn  =  0,  then  ip  =  ipp.  Avoiding  the  trivial  case  where  h(n)  =  0  for 
all  n,  at  least  one  of  Gp  and  G ^  must  be  nonzero.  If  Gp  >  0,  then  we  can  realize  ip p  as  a 
filter  ipf,  with  impulse  response  h*p{n )  =  hp(n)/Gp  >  0  Vn,  followed  by  the  gain  factor  Gp. 
Likewise,  if  Gn  <  0,  we  can  realize  ip^  as  a  filter  ip*N  with  impulse  response  h^(n)/G^r  >  0 
Vn,  followed  by  the  gain  factor  G n.  The  filters  ipp  and  ip*N  satisfy  the  requirements  of 
Theorem  8  or  9  and,  hence,  can  be  represented  exactly  as  suprema  of  erosions.  Thus  the 
proof  is  complete.  Q.E.D. 

The  requirement  for  absolute  summability  of  the  impulse  response  in  Theorem  10  is 
equivalent  to  requiring  that  the  LSI  filter  be  stable  in  the  bounded-input  bounded-output 
sense.  In  addition,  the  gains  Gp  and  Gat  mentioned  in  the  above  proof  may  be  equal  to 
one,  in  which  case  we  can  rephrase  Theorem  10  as  follows.  Any  stable  LSI  filter  can  be 
represented  exactly  by  the  sum  of  (at  most )  two  suprema  of  erosions. 

The  representations  in  (38)  and  (40)  might  be  useful  in  analysis  of  LSI  filters.  They 
are  not  useful,  however,  for  exact  practical  realization  because  the  LSI  filters  have  an 
infinite  number  of  kernel  or  basis  functions.  In  the  case  where  a  LSI  filter  admits  a 
representation  upon  basis  functions,  if  we  quantize  their  amplitude  and  bound  their  range 
between  certain  limits,  the  supremum  operation  in  (40)  will  be  replaced  by  the  maximum 
over  a  finite  ensemble  of  basis  functions.  Of  course,  this  realization  will  only  approximate 
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the  true  response  of  the  LSI  filter.  The  advantages  of  such  a  realization  of  the  linear 
filter  would  be  to  realize  it  only  by  using  max-min  and  additions  and,  thus,  avoiding 
multiplications.  Naturally,  there  are  many  questions  that  arise:  How  to  quantize  and/or 
bound  the  amplitude  range  of  the  basis  functions,  and  how  to  quantify  the  approximation 
error?  The  answers  to  these  questions  are  still  the  object  of  continuing  research. 

5  CONCLUSIONS 

Signals  can  be  classified  into  sets  (binary  signals)  and  functions  (multilevel  signals).  Filters 
can  be  classified  into  set-processing  (SP)  and  function-processing  (FP).  Certain  FP  filters 
are  function-  and  set-processing  (FSP).  We  provided  necessary  and  sufficient  conditions 
for  FSP  filters  to  commute  with  thresholding,  because  then  they  can  be  interpreted  as  SP 
filters.  In  this  analysis  we  considered  the  set  as  the  primary  concept.  Thus,  a  function  can 
be  represented  by  an  ensemble  of  sets  (its  cross-sections )  or  by  a  single  set  (its  umbra). 
Set  operations  on  umbrae  or  cross-sections  induce  some  isomorphic  operations  on  the 
respective  functions. 

The  four  basic  morphological  filters  are  the  erosion,  dilation,  opening,  and  closing, 
and  they  all  stem  from  Minkowski  set  addition.  We  introduced  two  new  morphological 
filters,  the  open-closing  and  clos-opening,  which  behave  similarly  to  median  filters  (see 
also  Part2).  These  six  filters  are  translation-invariant  (with  respect  to  shifts  of  both  the 
argument  and  the  amplitude  of  signals),  increasing,  nonlinear,  and  generally  noninvertible. 
Several  properties  of  FP  morphological  filters  have  been  studied  concerning  the  conditions 
for  commuting  with  thresholding,  the  fixed  points  of  opening  and  closing,  the  invertibility 
of  erosions  and  dilations,  and  the  difference  between  binary  and  multilevel  structuring 
functions.  Some  attractive  features  of  morphological  filters  are:  l)  Simplicity  and  par¬ 
allel  implementation  of  FSP  filters  (Pointwise  min/max  or  Boolean  AND/OR  of  shifted 
versions  of  the  signal);  2)  Separability,  i.e.,  if  a  2-D  function  g  is. the  Minkowski  sum 
of  two  1-D  functions,  then  the  2-D  morphological  filtering  by  g  reduces  to  a  cascade  of 
two  1-D  morphological  filters;  3)  Numerous  applications  in  image  processing  and  analysis; 
4)  Systematic  detection  and  quantification  of  the  shape  and  size  of  geometrical  features 
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in  signals;  5)  Operate  on  signals  of  both  discrete  and  continuous  argument;  6)  Duality ; 
for  each  morphological  filter  operating  on  a  signal  there  is  a  dual  filter  operating  on  the 
background  of  the  signal;  7)  Increasing  morphological  FSP  filters  commute  with  threshold¬ 
ing: i  this  reduces  a  multilevel  to  a  binary  signal  filtering,  which  is  easier  to  analyze  and 
implement;  8)  Erosions  or  dilations  are  the  prototypes  of  a  large  class  of  linear  and  nonlin¬ 
ear  filters;  and  9)  Morphological  filters  look  at  signals  under  study  as  sets  and  are  defined 
through  logical  relations  rather  than  arithmetic  ones;  consequently,  if  a  signal  processing 
problem  is  stated  in  terms  of  logical  relations,  then  it  can  be  expressed  directly  in  terms 
of  mathematical  equations  containing  morphological  operations. 

The  main  difficulties  in  their  analysis  or  design  arise  from  their  nonlinearity  and  the 
lack  of  analytic  criteria  to  choose  a  structuring  set  or  function. 

We  have  related  morphological  to  linear  filters  as  follows.  Linear  translation-invariant 
(LTI)  filters  are  linear  shift-invariant  (LSI)  filters  with  dc-gain  equal  to  one.  LSI  filters 
are  increasing  iff  they  have  nonnegative  impulse  response.  A  LTI  filter  can  be  uniquely 
characterized  by  the  set  of  its  kernel  functions.  An  increasing  LTI  filter  can  be  exactly 
represented  as  a  supremum  of  erosion  by  all  its  kernel  functions;  if,  in  addition,  the  filter 
is  discrete  and  its  impulse  response  is  of  finite  extent,  then  it  can  be  represented  as  the 
suprema  of  erosions  only  by  its  minimal  kernel  functions,  which  can  be  found  by  solving 
a  linear  equation.  Finally,  any  stable  LSI  filer  is  exactly  represented  as  the  sum  of  two 
weighted  suprema  of  erosions.  The  practical  disadvantage  of  the  above  representation  is 
that  it  uses  an  infinite  number  of  kernel  functions.  The  advantages  are  that  linear  convolu¬ 
tions  can  be  realized  by  using  only  min/max  and  additions  (without  any  multiplications), 
and  that  linear  filters  have  been  related  to  a  large  class  of  nonlinear  filters. 
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TABLE  I 


Isomorphic  operations  between  functions,  their  cross-sections,  and  their  umbrae 


FUNCTIONS 

CROSS-SECTIONS 

(all  t  e  V) 

UMBRAE 

/Ay 

Xt(f)nXt(g) 

U(f)  n  U(g) 

/  Vy 

-  *.(/)  U  X,(j) 

U(f)L>U(g) 

minf(x)  =  — oo* 

0 

0 

pinf(x)  =  +00* 

D 

E=  Dx  V 

f  <9 

Mf)  Q  Mg) 

u(f)  c  O-(ff) 

*for  all  x  €  D. 


TABLE  II 


Properties  of  Set-  and  Function-Processing  Filters 


Properties 

SP  filter  * 

FP  filter  ip 

translation-invar. 

*M.)  =  [*(*)]. 

W[x  -  y)  +  c]  =  M/)](s  -  y)  +  c* 

increasing 

AC  B  =>  'F(A)  C  'F(B) 

f  <9  =>  1>(f)  <  1>{g) 

extensive 

¥(A)  D  A 

rp{f)  >  f 

anti-extensive 

'P(A)  C  A 

W)  <  f 

idempotent 

tf[¥(A)]  =  'F(A) 

V#(/)|  =  *P{f) 

*x,y  6  D  and  c  €  V. 


38 


CAPTIONS  OF  FIGURES 


Figure  1.  A  function  /,  its  cross-section  Xt(f)  at  level  t ,  and  its  umbra  £/(/). 

Figure  2.  Reconstruction  of  a  function  from  its  cross-sections. 

Figure  3.  (a)  Umbra  of  a  set  B\  (b)  Umbra  and  graph  of  a  function  /. 

Figure  4.  Isomorphic  operations  between  sets  and  functions. 

Figure  5.  Erosion,  dilation,  opening,  and  closing  of  X  by  B  (the  shaded  areas  correspond 
to  the  interior  of  the  sets,  the  dark  solid  curve  to  the  boundary  of  the  transformed 
sets,  and  the  dashed  curve  to  the  boundary  of  the  original  set). 

Figure  6.  Dilations  and  erosions  of  discrete  sets:  (a)  Minkowski  subtraction,  (b)  Erosion, 
(c)  Minkowski  addition,  (d)  Dilation,  (e)  Forming  larger  sets  as  the  Minkowski  sum 
of  simpler  sets.  (•  —  set  points;  +  marks  origin  (0,0)  of  Z2.) 

Figure  7.  A  2-D  structuring  element  B,  a  1-D  structuring  function  g,  a  1-D  structuring 
set  5,  and  their  umbrae. 

Figure  8.  Erosion,  dilation,  opening,  and  closing  of  a  function  by  a  set  B  =  {—2,  —1, 0, 1, 2}. 
(The  dashed  curve  refers  to  the  original  function.) 

Figure  9.  Morphological  filtering  of  a  cosine  coswi  by  the  structuring  function  g(x)  — 
A(coso.’x  —  cos  wl),  —L  <  x  <  L.  [L  =  0.397r/u;.) 

Figure  10.  A  1-D  original  function  /  and  its  morphological  filtering  by  a  rectangle  ( B  = 
{n  £  Z  :  —5  <  n  <  5}),  a  disk  (ff(n)  =  5\/25  —  n2,  n  £  B),  and  a  parabola 
( h(n )  =  2(25  —  n2),  n  £  B). 

Figure  11.  Geometric  interpretation  of  the  relation  between  the  finite  impulse  response 
h  and  the  basis  functions  g  of  an  increasing  LTI  discrete  filter. 
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